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(57) An interactive display apparatus comprises an audio subsystem (4), a control subsystem (5) and a 
plurality of video subsystems {2, 3). The video subsystems (2, 3) have access locally to Image data, including 
Image files and live video. The video subsystems (2, 3) are controlled by the control subsystem (5) which then 
sends command messages to the video subsystems (2, 3). A person watching the display (22, 32) of one of the 
video subsystems (2, 3) can dial into the audio subsystem (4) and thereby control the operation of the video 
subsystem (2, 3). To do this, the audio subsystem (4) notifies the control subsystem (5) of incoming audio 
command signals. It is to be noted that when the system is on line, the control subsystem (5) does not transfer 
image data to the video subsystem (2, 3) but merely sends commands setting the format of the images 
displayed on the screens (22, 32). 
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Interactive Display System 

tr. 

Description 

The present invention relates to an interaaive display system and an interactive 
J display method. 

The display of information in public places is most conmionly provided using 
billboards. Billboards are essentially static, although in recent years billboards have 
been developed which cycle by electromechanical means through two or more 
10 images. Another development is the use of large video displays which are used to 
display advertisements, such as are produced for television but without sound, and to 
display information and action replays at sporting events. 

A problem with these known display apparatuses is that the sequence of images, if 
25 any, is fixed. For the purposes of advertising, it is desirable that the viewer's 
attention be captured and retained. However, if the viewer is merely a passive 
recipient of a fixed sequence of images, the viewer soon loses interest and turns away. 

According to the present invention, there is provided an interactive display system 
20 comprising: an audio subsystem configured for receiving audio communication 
signals via a wide area communications network and generating control signals in 
dependence on the received audio communication signals; a control subsystem 
configured to respond to said control signals from the audio subsystem by issxiing 
display conunands, and a video subsystem including display means, configured to be 
25 responsive to said display commands to display on the display means images defined 
by image data, wherein the video subsystem is remote firom the control subsystem 
and said image data is provided to the video subsystem independently of the display 
commands. 



30 According to the present invention, there is also provided an interactive display 
method comprising the steps of: 




providing a supply of images dau at a remote display station; 
receiving at a central station an audio communication signal via a wide area 
conununications network and generating control signals in dependence on the 
received audio conmiunication signals; 
5 issuing from the central station a display conunand to the remote station in 
dependence on the received audio communication signal; and 
displaying an ims^ at the display station in dependence on the display conunand, 
said ims^e including a portion defined by image data from said supply. 

10 It will be appreciated that the use of a wide area network means that subsystems of 
the present invention may be located in different jtxrisdictions. Therefore, the 
applicant seeks protection for a video subsystem of a telephone-controlled interaaive 
display system including display means, configured to be responsive to display 
conmiands from a remote control subsystem to display on the display means ims^es 

75 defined by image data, said image data being provided to the video subsystem 

independently of the display commands, and means for making available to a person 
viewing the display means a telephone number that can be called to esublish an 
interactive relationship between said person and the display system using a telephone. 

20 It will be appreciated that the present invention has applications other than the 
provision of an enhanced "billboard". 

The use of a wide area conununication network, for example the Public Switched 
Telephone Network and public land mobile networks, means that the display system 
25 operator does not need to provide input devices at the video subsystem because a user 
can use a mobile telephone or a convenient payphone. The payphones at railway 
terminuses and airports often only have a simple hood for providing a degree of 
privacy. Consequently, the payphone structure in such locations is not necessarily an 
impediment to viewing of the display. 



Other wide area networks supporting audio conimunicarion» for example the 
Internet, may also be used. 

The audio conununication signals may comprise DTMF signals or speech signals, in 
5 which case the audio subsystem will be provided with speech recognition means. 

It should be noted that, while the system is "online", ims^e data is not transmitted 
between the control subsystem and the video subsystem. The display commands 
selea images for display and define the positions in which they are displayed. 

10 

As the image data is not being sent from the control subsystem in response to audio 
communication signals, as in viewdata systems such as Prestel, it is preferred that the 
video subsystem include local data storage means storing said image data for display 
in response to a display conmiand. However, this is not essential and the image data 

; J may be provided from a source of real-time video s^als, such as a video camera or a 
television tuner. The image data may also comprise program data for producix^ an 
imaqge. The program dau may be such that the image as it is displayed is altered in 
dependence on signals from the control subsystem. The local data storage means may 
comprise solid-state memory, ms^etic or optical disk or magnetic tape, or indeed 

20 any combination of these. 

Conveniently, the transmission of the display commands requires a bandwidth 
insufficient for the transmission of real-time video. Video having a frame rate greater 
than twenty frames per second is primarily meant by real-time video. The display 
25 commands require a bandwidth far less than could conceivably be occupied by real- 
time video signals using compression techniques conmierdally available before May 
1997. Conveniently, the control subsystem can be linked to the video subsystem by a 
communications channel havii^ supporting a maximum bit rate of 64kbits as 
provided by an ISDN connection. 

30 




Preferably, the commimicacion between the control subsystem and the video 
subsystem is session based rather than transaaion based. Thus, in this preferred form 
the present invention operates in a manner quite distinct from the World Wide Web. 

5 Having established an audio channel between a user and the audio subsystem, using 
for example a telephone, a resource is available for supplementing the video display 
with an audio capability. Preferably, therefore, the control subsystem is configured 
to respond to control signals from the audio subsystem by issuing audio subsystem 
control commands. 

10 

A problem with the use of large video displays for advertising is the lack of sound 
accompanyment, e.g. music or dialogue. Sound can be provided using loudspeakers. 
However, this is undesirable in public places. A preferred embodiment of the present 
invention addresses this problem. In this embodiment, the control subsystem is 
13 configured to respond to a control signal to issue both a display command for causing 
a moving image to be displayed by the video subsystem and an audio subsystem 
control command to cause the audio subsystem to make available via the wide area 
communications network audio signals for accompanying the moving image. 

20 The audio capability may also be used to provide instructions to a user. 

In a system havii^ a plurality of video subsystems, the control subsystem may be 
implemented by separate a control process means for each video subsystem. The 
control process means may comprise different machines or separate software objects 
2S implemented on one machine. For large systems, a plurality of software objects may 
be implemented on each of a plurality of machines. 

Preferably, each image configuration is controlled by means of a corresponding 
server. The appropriate server being used by a control process means for issuing 
30 display commands in response to control signals from the audio subsystem. 



The audio subsystem may be configiu'ed to accept audio communication signals from 
a plurality of sources. If such a system has the audio capability referred to above, the 
audio subsystem is preferably configurable, under the control of the control 
subsystem, to send the same or different audio signak to each source. 

According to the present invention, there is further provided apparatus comprisii^ a 
display and processing means configured for controlling the display according to a 
stored program and user input commands input via a telephone network, wherein the 
user input commands comprise telephone dialling signals. Such apparatus may be 
used to enable a user to operate a menu system using their telephone. The apparatus 
may also be used for the playing of video games. If the apparatus is employed for 
games playing, it is preferred that the processing means be configured for controlling 
the display according to user input commands input contemporaneously from 
different sources via the telephone network. 

According to the present invention, there is still further provided a videophone 
system for use with mobile telephones comprisii^: a first video subsystem including a 
display and a video camera and located in an area covered by a mobile telephone 
network; a second video subsystem indudii^ a display and a video camera and 
located in an area covered by a mobile telq)honc network; communication means for 
conveyii^ signals firom the video cameras between the video subsystems; and an 
audio subsystem configured for receiving first and second concurrent telephone calls 
from mobile telephones and providing an audio connection between said calls to 
enable the calling parties to converse. 

According to the present invention, there is still further provided a telephony 
interface comprising conneaing means for connecdon to a plurality of telephonye 
circuits, signal processing means for producing audio signals from audio signal data 
and switching means configured to selectively applying audio signab produced by the 
signal processing means simultaneously to a plurality of telephone circuits by means 
of the conneaion means. 
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Preferably, the switching means is configured to seleaively connect telephony 
circuits to each other by means of the conneaion means. More preferably, the switch 
means includes processing means operating under the control of a program or 
5 programs, the program or programs defining a set of switching states of the switching 
means. 

In this context, "telephone circuit** means a connected telephone call having the 
interface acting as terminal equipment. 

10 

An embodiment of the present invention will now be described, by way of example, 
with reference to the accompanying drawings, in which: 
Figure 1 is a block diagram of the main components of a system embodying the 
present invention; 
iJ Figure 2 is a block diagram of the audio subsystem of Figure 1; 

Figure 3 is a block diagram of the telephony interface of the audio subsystem of 
Figure 2; 

Figure 4 is a block diagram of the hardware of the control subsystem of Figure 1; 
Figure 5 is a block diagram of one of the video control processors of Figure 1; 
20 Figure 6 shows the initial display format of the first video subsystem of Figure 1; 
Figure 7 shows the initial display format of the second video subsystem of Figure 1; 
Figure 8 shows a display format; 
Figure 9 shows another display format; and 
Figure 10 shows another display format. 

25 

Referring to Figure 1, an interactive display system comprises a control centre 1, a 
first video subsystem 2 and a second video subsystem 3. The control centre 1 
comprises an audio subsystem 4, a control subsystem 5 and a management subsystem 
6. The control subsystem 5 comprises first and second control processors 5a, 5b. 



30 



The audio subsystem 4 is conneaed to the Public Switched Telephone Network 7 by- 
four telephone lines 8 and to a direa audi^ feed 46. The direa audio feed 46 
comprises the sound channel or channels from a broadcast television signal. The 
Public Switched Telephone Network 7 is linked via a gateway mobile switching 
S centre (not shown) to a public land mobile network 9 which includes a base 
transmitter site 10. The audio subsystem 4, the control processors 5a, 5b and the 
management subsystem 6 are interconnected by local area network 11. 

The first video subsystem 2 comprises a video control processor 21 and a display 
10 screen 22^ such as a Sony Jumbotron (RTM), controlled by the video control 

processor 21. The video control processor 21 is linked to the first control processor 
5a by an ISDN connection 23. An antenna 24 for receiving television signals is 
coupled to the video control processor 21 via a timer 25. A video camera 26 for 
sensing the scene in front of the display screen 22 is also coupled to the video control 
IS processor 21. 

The display screen 22 is mounted in a public place within a cell of the public land 
mobile network 9, covered by the base transmitter site 10. Consequently, subscribers 
to the public land mobile network 9 can use their mobile stations 27, 28 while 
20 watching the display screen 22. 

The second video subsystem 3 is similarly arranged at another location and comprises 
a video control processor 31, a display screen 32, such as a Sony Jumbotron (RTM), 
an antenna 34, a tuner 35 and a video camera 36. The video control processor 31 is 
2S linked to the second control processor 5b by an ISDN connection 33. Similarly also, 
subscribers to the public land mobile network 9 can use their mobile stations 37, 38 
while watchii^ the display screen 32. 

A broadband link 12 is provided between the video subsystems 2, 3. The video 
30 signals from the cameras 26, 36 of each video subsystem 2, 3 are transmitted to the 
other video subsystem 2, 3 in real time over the broadband link. 




By calling the audio subsystem 4, subscribers to the public land mobile network 9 can 
use their mobile stations 27, 28, 37, 38 to control the inures displayed by the display 
screens 22, 32 and receive accompanying audio signals. The images may comprise 
video presentations, advertising or informational material, games that can be played 
using the keys of a mobile station 27, 28, 37, 38 or Uve video from a camera 26, 36 for 
conferencing. 

Referring to Figure 2, the audio subsystem 4 generally comprises a microcomputer 
having a processor 41, memory 42 and an internal data and address bus 43. A 
telephony interface 44 comprises a pair of 4<hannel analogue telephony cards and 
interfaces the audio subsystem 4 to the telephone lines 8 and the direa audio feed 46. 
A network card 45 is provided for communication with the control subsystem and 
the management subsystem 6 via the local area network 11. 

Referring to Figure 3, the telephony interface 44 comprises eight digital signal 
processors DSPO, DSP7, interconneaed by a bus 441 which also provides a path 
for the exchange of dau between the telephony interface and the processor 41 of the 
audio subsystem 4. The telephony card 44 has six input/output connections, four of 
which tO, t3 (correq)onding to channels ''O" to ''3") are to the telephone lines 8 and 
two of which aO, al are to the direct audio feed 46. Switching circuitry 442 is coupled 
to the digital signal processors DSPO, DSP7 and the input/output conneaions tO, 

t3, aO, al. The switching circuitry is controllable to connea any of the 
input/output connections tO, t3, aO, al to each other and to any of the digital 
signal processors DSPO, DSP7. These conneaions can be effeaed independently 
for forward and return signab. 

In the present embodiment, the control software for the switching circuitry 442 is 
configured to effea a subset of all the possible interconnections. The 
interconnections that are permitted are terms "groups" hereinafter. The definitions 
of these groups are as follows:- 
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multiplay group any of digical signals^rocessors DSP4| DSP7 connected to 
one or more of input/output connections tO, t3 solely for 
the output of signals from digital signals processors DSP4, 



IS For control purposes, there are considered to be four multiplay groups, "1", ...» ""4** 
involving respectively digital signal processors DSP4, DSP7, two conference 
groups, "S", "6" however, there may be more or less), and two live groins "7", ^'S" 
involving input/output conneaions aO, al respeaively. 

20 Signals entering the interface from input/output connections tO, t3 are always sent 
to respeaive one of digital signal processors DSPO, DSP3, 

The function of the audio subsystem 4 is to detea events on the telephone lines 8, 
pass event notifying messages (NEW_CON^fECT, DISCONNECT, FILE^END, 
2S MULTI^PLAY^FILE^END, DIGIT_PRESS) to the control subsystem 5 (see Figure 
1) and route output audio to the correa telephone line 8 under the control of the 
control subs}^stem 5. The meaning of these me5s^;es will become apparent from 
description of the operation of the present embodiment hereinafter. 



DSP7 to the telephone lines 8; 



conference group 




10 live group 



connection of input/output connections aO or al to 
input/output conneaions tO, t3 solely for outputting via 
input/ output conneaions tO, t3 signak input via 
input/output conneaions aO, al. 



30 Since incomii^ signals in channeb "0'' to *'3" are always direaed to a respective one 
of digital signal processors DSPO, DSP3, events on the telephone lines are detected 
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by these digital signal processors DSPO, DSP3. For the detection of events on the 
telephone lines 8» the audio subsystem 4 implements a state machine defined by 
program code stored in the memory 42. Each channel can be in any one of five 
states: IDLE, RING, ACTIVE, CONFDSP and SFP- A channel is in the IDLE state 

5 if it is not being used, for instance if the telephone line 8 associated therewith is in the 
on-hook state* Conversely, a channel is aaive if it is being used, for instance if the 
telephone line 8 associated therewith is in the off-hook state. The RING state occurs 
when a call is routed to one of the telephone lines 8 and persists until the telephony 
interface 44 places the line in the off-hook state. The CONFDSP state is used for 

10 channels which are not conneaed to telephone lines and whose digital signal 

processors are being used by a multiplay group. The SFP state indicates that a file 
playing on a channel cannot be interrupted and that some special aaion, such as 
going on-hook, may be required when the file finishes. 

IS Each channel also has a group state. If a channel is member of a groxip, its group state 
is the number of the group of which it is a member. Group state "0" is used to 
indicate that a channel is not a member of any groups. When a channel is not a 
member of a group, it is configured so that audio may be output fi-om its respective 
digital signal processor DSPO, DSP3 to its respeaive telephone line 8. 

20 

It is desirable that the control subsystem 5 (see Figure 1) should not have to know 
about the actual implementation of channels and groups in the audio subsystem 4. 
Furthermore, as will be explained in more detail below, a plurality of control 
processes running in the control subsystem 5 may need concurrent access to the 
25 resources of the audio interface 44. Accordingly, the ''real" channels and groups, 
implemented by the audio subsystem 4, are mapped by the audio subsystem 4 onto 
virtual chaimels and groups used by the control subsystem processes. The mapping is 
performed by means of virtual channel and group ubles maintained by the audio 
subsystem 4. 
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By way of example, if a first call is received on the telephone line 8 associated with 
channel the audio subsystem 4 associates real channel "2" with virtual channel 
"0" for the first control processor 5a. If, subsequently, a call is received on the 
telephone line 8, associated with real channel ''0'', the audio subsystem 4 associates the 

3 real channel •O" with virtual channel ""O". When these calls are terminated, the virtual 
channels associated therewith again become available for mappix^ onto any real 
channel. Real channels "T" and "3" arc for the second control processor 5b and are 
similarly mapped onto virtual channeb ^0* and '^l" for second control processor 5b. 
It will be appreciated that this channel mapping can be expanded readily for mapping 

10 much larger numbers of real channels onto virtual channels for a larger number of 
control processors. 

Conversely, if a control subsystem process conunands the audio subsystem 4 to play 
an audio file on its virtual channel the audio subsystem 4 retrieves the 
corresponding real channel, channel 0 in this example, from the channel table. 

The mapping of each type of group is handled similarly. That is, each real group can 
be mapped onto the members of a predetermined subset of the virtual groups 
available for a control processor 5a, 5b. For instance, the first control processor 5a 
20 may have available, three virtual multiplay groups, to ''3'', two conference groups, 
"4", "5*, and one live play group "6". 

Referring to Figure 3, the control processors 5a, 5b each comprise a microcomputer 
having a processor 51, memory 52 and an internal data and address bus 53. A 
23 network card 54 is provided for commimication with the audio subsystem 4 (sec 
Figure 1) and the management subsystem 6 (see Figure 1) via the local area network 
11 (see Figure 1). An ISDN interface 55 is provided for communication with the 
respective video subsystem 2, 3 (see Figure 1). 



30 



The memory 52 stores program code for a multitasking operatii^ system and 
application program code for a control process and a library of "interactive format 
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servers". The control processes, run on respective control processors 5a, 5b, are 
implemented as instances of the same software objea. When a control process is run, 
the mans^ement subsystem 6 sets its controlled video subsystem property to a unique 
value, in this case either the first or the second video subsystem 2, 3, and sets its initial 
interactive format server property. 



10 



15 



Each member of the library of interactive format servers defines one display format 
for a display screen 22, 32, and includes responses to various events and identification 
accompanying audio files. 

When, for example, the control process is instruaed to cause a display format to be 
used, it calls the appropriate interaaive format server which returns initial format 
definition dau. The control process transmits the format definition data to the 
respeaive video subsystem 2, 3. The interactive format server will also usually return 
audio command messages which are sent to the audio subsystem 4 by the control 
process. 



20 



The control process responds to messa^ fi*om the audio subsystem 4 and the 
respeaive video subsystem 2 by passing on the messs^es to the interactive format 
server and then sending any messages returned from the interactive format server to 
the audio subsystem 4 or the respective video subsystem 2, 3 as necessary. 



The set of control process to audio subsystem messages comprises: 



25 sPlay ch filename 

sStopch 

cot&chgrp 

deConf c& 

livec^ 
30 delive ch 



start a single user file playing to channel ch 
stop a single user file play on chaimel ch 
Add channel ch to conference group grp 
Remove channel ch from conference group grp 
Add channel ch to the live group 
Remove channel ch from live group. 



mStart grp filename [ch ...J Stan a multiplay group with the specified id, playing the 

file filename to the channeb specified in the remaining 
arg$ (if any)* If group ahready exists, just start the file 
and add members. 

S mAdd grp ch [d>..J Start a multiplay group with the specified members. If 

group already exists just add members. 
mRemove grp d} [ch..J Remove members from the specified mtdtiplay group. 
mStop grp Stop the file being played on the multiplay group. 

10 The set of control process to video subsystem messs^es comprises: 

< L:G:ni :n2 > Make group nl be in the biggest video window, and n2 

in the smallest video window. 

< F: V:^ + \file > Play the filename in group g. 

15 < F:V:g:- > Stop the video beii^ playing in group g. 

< \J\ch\gi + > Add user ch to the group g. (represent on screen that the 

user is in group g. 
<\5:d)ig>> Remove user ch from group g. 

20 The groups referred to in the control process to video subsystem messages are not 
those referred to in the control process to audio subsystem messages. 

Referring to Figure 4, the video processor 21 of the first video subsystem 2 comprises 
a microcomputer havii^ a processor 211, memory 212, a lai^e opacity hard or 

25 optical disk drive 213 and an internal data and address bus 214. An ISDN card 215 is 
provided for communication with the first control processor 5a of the control 
subsystem 5 (see Figure 1). The TCP/IP protocol is used for communication 
between the video processor 21 and the first control processor 5a. A video card 216, 
including video RAM, is provided for driving the display screen 22 (see Figure 1). A 

30 multimedia I/O imit 217 is provided for receiving video signals from the camera 25 
and from the antenna 24 via the tuner 25. The antenna 24 and tuner 25 could be 




replaced by a video tape recorder. The multimedia I/O unit 217 also enables the 
video from the camera 25 to be output to the broadband link 12 and video from the 
broadband link 12 to be received for display. 

5 The disk drive 213 stores still and moving image files, for instance files in JPEG 
format or MPEG f ormat» for use in the display. The antenna 24 and the tuner 25 are 
configured for receiving broadcast television progranunes. The tuner 25 may include 
decryption means so that encrypted transmissions can be received. 

10 When the video processor 21 receives format definition dau from the first control 
processor 5a, it interprets the received data and sends corresponding commands to the 
video card 216 to construct the static elements of the display. The display may be 
subsequently modified with dynamic elements in response to messages from the 
control subsystem. It should be noted that the static elements may comprise moving 

IS ims^es, for instance a looping video, and the dynamic elements may comprise still 
images which are dynamic in the sense that they can be constructed or hidden 
dynamically. 

The video processor 21 also continually routes the video fi-om the camera 25 to the 
20 broadbank link 12. 

The management subsystem comprises a conventional microcomputer configured for 
use on a local area network. The microcomputer is programmed to perform 
management tasks such as data logging. An operator can also control the audio and 
2S control subsystems 4, 5 from the management subsystem 6. The management 

subsystem is also used to set the order in which display formats are used. The nature 
of this programming will become apparent from the following description of the 
operation of the present embodiment. 

30 The operation of the present embodiment will now be described using exemplary 
display formats and user actions and with reference to Figures 1 to 10. 
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The first stage in the operation of the present embodiment is the off-line 
configuration of the control processors 5a, 5b, the audio subsystem 4 and the video 
subsystems 2, 3. Each video subsystem 2, 3 will be required to produce a number of 
displays* Some, if not all, of these will require still or moving image files and these 
files must be loaded into the disk drives 213 of the video processors 21, 31. To do 
this an operator uses the management subsystem 6 to instruct the control subsystems 
to transmit the files to the video subsystems 2, 3 from a storage device (not shown) 
via the ISDN links 23, 33 during system downtime. Similarly, the operator uses the 
management subsystem 6 to instrua the control subsystem to transfer audio files for 
accompanying the pages from a storage device, which may be at the mans^ement 
subsystem 6, to the audio subsystem 4. It is to be noted that the image files are 
transferred while the system is off-line. Accordingly, video files can be transmitted 
using a much greater time than their playing time, thereby reducing the bandwidth 
required for their transmission. 

Once the audio and video resources have been distributed, the operator uses the 
management subsystem 6 to instantiate the control process for each of the video 
subsystems 2, 3 and set the order of the display formats for each video subsystem 2, 3. 
The control processes are instantiated with their video subsystem properties set to 
indicate the first and second video subsystems 2, 3 respeaively and initial interactive 
format server property values corresponding to the initial display format for the 
respective video subsystem 2, 3. 

When the control processes are instantiated, they make calls to their interactive 
format servers for the initial display formats of the first and second video subsystems 
2, 3 respeaively. The format definition data for these display formats is returned to 
the control processes and then dispatched to the video subsystems 2, 3. 

When the first video processor 21 receives the format definition data for its initial 
display format, its processor 211 stores it in the memory 212. The processor 211 then 
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generates commands for the video card 216 on the basis of the format definition data. 
The video card 216 responds to these commands by generating the image on the 
display screen 22. In this case^ the initial display comprises simply a field of colour 
with an invitation to call a telephone number, as shown in Figure 6, so it is not 
5 necessary to retrieve any background image files from the disk drive 213 or include 
video from the tuner 25 or the camera 25. However, the initial display could indude 
movix^ or still images if the designer so wished. 

The second video subsjrstem 3 operates in the same way as the first video subsystem 2 
10 to produce its initial display. In the present embodiment, the initial display format of 
the second video subsystem 3 is the same as that of the first video subsystem save that 
the telephone number displayed differs (see Figure 7). The telephone numbers differ 
so that the audio subsystem 4 can determine which display screen 23, 33 a public land 
mobile network subscriber is seeing. 

1$ 

While the initial displays are being set up at the video subsystems 2, 3, the audio 
subsystem 4 is instructed to start up by the management subsystem 6. During start 
up, the audio subsystem 4 initialises the channels, establishes network conneaions to 
the control processors 5a, 5b. 

20 

The system is now online. 

A first public land mobile network subscriber takes up the invitation to call the 
nimiber displayed by the first video subsystem 2 using his mobile station 27. The call 
25 is routed throi^h public land mobile network 9 and the Public Switched Telephone 
Network 7 to one of the lines 8 into the audio subsystem 4. The state of channel "0", 
corresponding to the line, consequently changes from IDLE to RING. 

The telephony interface 44 responds to the call by generatii^ an off-hook signal. 
30 This places channel "0" in the ACTIVE sute. When channel ''0" enters the ACTIVE 
state, the processor 41 of the audio subsystem 4 first identifies the called nxunber, 



^ .17- 



either using direa dial in (DDI) or from the channel number, if each line 8 is reached 
by only one telephone number. From thr called nimiber, the processor 41 identifies 
the video subsystem 2, 3 from which the call was made and consequently the control 
processor 5a, 5b to which messages should be sent. Having identified the first control 
5 processor 5a, the processor 41 makes an entry in the channel table linkii^ real 
channel ""O" to the first free virtual channel associated with the first control process 
56, in this case virtual channel "0". Finally, a NEW_CONNECT message is sent to 
the first control processor 5a by the processor 41. 

10 The first control process receives the NEW_CONNECT message and passes the 
NEW_CONNECT message to the interactive format server for the first video 
subsystem's initial format. The interactive format server determines that the 
response to a NEW CONNECT message is a jump to another display format called 
•*Tweenyr. Accordingly, the interactive format server returns a jump command, 

15 with Tweenyl as a parameter, to the first control process 56. 

On receiving the jump command, the first control process calls the interactive format 
server for display format ''Tweenyl" which is the next display format in the schedule 
provided by the management subsystem 6. This returns the format definition dau 

20 for "Tweenyl" which is then sent to the first video subsystem 2. The interaaive 

format server also returns an instruction to the audio subsystem 4 requiring it to play 
a welcome message file to the calling subscriber. This message is sent to the audio 
subsystem 4 causing the telephony interface to play the welcome message's file on 
digital signal processor DSPO. During the playing of the welcome file, channel ''O" is 

23 in the SFP state to ensure that the whole welcome mess^e is heard by the subscriber 
imless he terminates the call. 

The first video subsystem 2 receives the format definition data and sets up the sutic 
elements of the display as described above. ''Tweenyl'* is shown in Figure 8 and has a 
30 patterned background 100 defined by an image file, two video windows 101, 102 and 
an eliptical region 103, labelled "continue". Instructional text is also displayed and 
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instructs the user to press 1 to hear the audio for the lefthand video window 101, 2 to 
hear the audio for the righthand video window 102, # to continue to the next display 
and * to listen to help. 

Although two video windows have been defined, the video is not played immediately 
because of the need to sychronize the videos with their accompanying audio files. 
Therefore, once the first video subsystem 2 has reported back that the display format 
has been set up and the audio subsystem 4 has reported the end of the welcome 
message with a FILE_END message, the first control process calls the interactive 
format server and receives a message for the first video subsystem 2 to start playing a 
first video file in the lefthand window 101 and a message to the audio subsystem 4 to 
start playing the accompanying audio using virtual multiplay group ""4" of the 
telephony interface 44. The first control process sends these messs^es to their 
respeaive destinations substantially simultaneously. The processor 41 of the audio 
subsystem 4 real multiplay group "4" and maps it onto virtual multiplay group ''I" 
for the first control process. 

Additionally under instructions fi-om the interaaive format server, the first control 
process sends a message to the first video subsystem 2 to start playing a second video 
file in the righthand window 102 and, substantially simultaneously, sends a message 
to the audio subsystem 4 to start playing the accompanying audio. The audio 
subsystem 4 allocates real multiplay group "2" for playing the accompanying audio 
file for the second video window 102 and maps it onto virtual multiplay group *2** 
for the first control process. The dispatch of a video play message and the audio play 
message, for the accompanying audio, may be staggered, typically by a few tens of 
milliseconds, to account for differing response times of the audio and video 
subsystems. 

When the playix^ of an audio file accompanying a video in a window 101, 102 
finishes the audio subsystem sends a MULTI_PLAY_FILE_£ND message to the first 
control process. Similarly, the first control process is informed when the playing of 




the video file finishes. When the first control process has received notification that 
the playing of both a video file and its accompanying axidio file have finished, the first 
control process forwards the messages to the interaaive format server. The 
interactive format server returns the audio and video file play commands which the 
i first control process sends to the audio subsystem 4 and the first video subsystem 2. 
This keeps the audio synchronised with the video. 

If the subscriber now presses the key of his mobile sution 27, the audio 
subsystem 4 identifies that "1" has been pressed by the subscriber on real channel "0" 

10 and sends a DIGIT^PRESS message to the first control processor 5a; the audio 
subsystem 4 identifies the correa destination control processor 5a, 5b from the 
channel in which the digit's DTMF signal was received. The DIGIT_PRESS message 
identifies the digit that has been pressed and the virtual channel corresponding to the 
real channel in which the digit's DTMF signal was received The first control process 

15 calls the interactive format server xising the digit's identity as a parameter and is 
returned messages for the first video subsystem 2 and the audio subsystem 4 
indicating that the subscriber wishes to listen to the audio for the lefthand video 
window* Accordingly, the first control process sends a ^mAdd 0 1" messs^e to the 
audio subsystem 4 to add virtual channel "0*^ to virtual multiplay group '"l" and a 

20 < U:0:1: + > message to the first video subsystem 2. The audio subsystem 4 responds 
to its message by adding real channel ""O** to the real multiplay group after 
accessing the virtual channel and group mapping tables. Consequently, the subscriber 
then hears the audio in the loudspeaker of his mobile station 27. The first video 
subsystem responds to its message by generating an indicum 104, representing the 

25 subscriber, adjacent the lefthand video window 101. 

If the subscriber now presses the ''2" key of his mobile station 26, the above process is 
repeated save that the messages sent to the audio subsystem 4 and the first video 
subsystem 2 are ""mAdd 0 2" and " < U:0:2: + > " respeaively. The audio subsystem 4 
30 responds to its message by removing real channel ''O'* from real multiplay group ""1"* 
and adding it to real multiplay group "^T so that the subscriber hears the audio 




accompanying the video in the righthand video window 102. The first video 
subsystem 2 responds to its messs^e by moving the indiciimi 104 to a position 
adjacent the righthand video window 102. 

J If at any time the subscriber presses the key of his mobile sution 26, the audio 
subsystem 4 identifies that has been pressed by the subscriber on real channel ""O** 
and sends a DIGIT_PRESS messs^e to the first control processor 5a. The 
DIGIT_PR£SS message identifies the digit that has been pressed and the virtual 
channel corresponding to the real channel in which the digit's DTMF signal was 

10 received. The first control process calls the interactive format server using the digit's 
identity as a parameter and is retximed a messages for the audio subsystem 4. The 
first control process responds by sending these messages to the audio subsystem to 
remove the real channel "0" from real multiplay group or "2" (as necessary) and 
start the help file playing on digital signal processor DSPO which is permanently 

13 allocated to real channel '0**. The first control process 56 also sends a message to the 
first video subsystem 2 to remove the indicium 104 fi-om the displayed image. When 
the help file has finished, the audio subsystem 4 sends a FILE_END mess^ to the 
first control process 56 and resets the state of real channel "0** to ACTIVE. 

20 If the subscriber presses the key of his mobile station 26, the audio subsystem 4 
identifies that has been pressed by the subscriber on real channel "'O" and sends a 
DIGIT_PRESS message to the first control processor 5a. The DIGIT_PRESS 
message identifies the digit that has been pressed and the virtual channel 
corresponding to the real channel in which the digit's DTMF signal was received. 

25 The first control process receives the message and calls the interactive format server 
using the digit's identity as a parameter and is returned a " < U:0:3: + > message for 
notifying the first video subsystem 2 that the subscriber is ready to move to the next 
page. The first control process 56 then sends the message to the first video subsystem 
2 which responds by moving the indicium 104 into the eliptical window region. 
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After each message from the audio subsystem 4 has been processed by the first 
control process, the control process determines whether all of the subscribers using 
the first video subsystem 2 are ready to move to the nesct display format. In the 
present situation, only one subscriber is using the first video subsystem 2 and the first 
5 control process therefore inunediately connects to the interaaive format server for 
next display format, ^resentarion Domain''. 

The operarion of the low-level messaging between subsystems will now be apparent 
and will be largely omitted from the following in the interests of clarity. 

10 

When the interactive format server for *Tresentation Domain" is conneaed to, the 
first control process sends the format definition data to the first video subsystem 2 
which then constructs the new display. Referring to Figure 8, "Presentation 
Domain" comprises a bad^ound 105 defined by an image file, a video window 106 
13 and instruaional informauon. Initially, the image received by the antenna 24 and the 
tuner 25 is displayed in the video window 106 and audio from the direct audio feed 
46 is fed to the real live group "7^ in the audio subsystem 4. The direct audio feed 46 
receives audio from another tuner (not shown) tuned to the same channel as the tuner 
25 of the first video subsystem 2. 

20 

If the subscriber presses the "1" key on his mobile starion 27, he will be connected to 
the real live group "6" and be fed the audio from the direa audio feed 46 and the first 
video subsystem 2 will display the video from the antenna 24, if it is not already 
doing so. If the user presses the '*2' key on his mobile station 27, the first video 

25 subsystem 2 is instructed to play a video file fi-om the disk drive 213 in the first 

window and the audio subsystem 4 is instruaed to play the accompanying audio file 
on real multiplay group '"l" and switch the subscriber's channel from real live group 
''6'' to real multiplay group ""l**. Pressing the key causes an audio help file to be 
played to the subscriber and pressing the notifies the first control process that the 

30 subscriber is ready to move on. 




When the subscriber has indicated that he is ready to move on, the first control 
process sets up the next display format, caUed *'Twecny2". •'Tweeny!'* is identical to 
•'Tweenyl" save for the video displayed in the video windows and the accompanyix^ 
audio files. 

5 

If, while "TweenyZ** is being displayed, a second subscriber calls the audio subsystem 
4 using his mobile sution 28, he will be played a welcome message and may then 
interaa with the display. The second subscriber can selectively listen to the audio for 
the displayed video by pressing the "r and **2'* keys on his mobile station 28. The 
10 presence of the second subscriber is indicated by a further distinaive indicium in the 
display image. 



Once a subscriber has indicated his desire to move on by pressing the key on his 
mobile station 27, 28, his indicium will move to the eliptical region. Until the other 
15 subscriber indicates his desire to move on or terminates his call, a subscriber who has 
pressed the "#'' key will still be able to listen seleaively to the audio for the displayed 
video. However, when he presses the or "2" key his indicium will not move 
from the eliptical region. 



20 When both subscribers have indicated a desire to move on, the first control process 
sets up the next display format. This display format comprises an interaaive game 
(see Figure 9) in which each subscriber has control of a snake 107, 108 on the display 
screen 22 and must steer their snake to ''eat" objects 109 appearing at random; the 
more objects a snake eats, the longer it grows. The subscribers can turn their snakes 

25 to the left or the right by pressing the ''4" and ''iT keys on their mobile sutions 27, 28 
respeaively. 

If the second subscriber terminates his call at this point, the audio subsystem 4 sends a 
DISCONNECT messs^e to the first control process. The first control process 
30 forwards this mess^e to the interaaive format server which deletes its record of the 
second subscriber. The first control process also deletes its record of the 




disconnecting subscriber. In response to the subscriber's disconnection, the audio 
subsystem 4 frees the real and virtual channels allocated to the second subscriber and 
removes his channel from any groups of which it had been a member. The first 
control process also sends a message to the first video subsystem 2 causing it to delete 
5 the indicium for the second subscriber. 

When the first subscriber indicates his wish to move on, the first control process sets 
up the next display format, called "TweenyJ". "TweenyS** is identical to ps^e 
"Tweeny 1" save for the video and audio files played. 

10 

When the first subscriber indicates his wish to move on from "TweenyS", the first 
control process sets up the next display format, called "Conference Domain" by 
coimeaing to the appropriate interaaive format server. The "Conference Domain** 
format comprises two video windows which display respectively the video from the 
15 camera 26 of the first video subsystem 2 and the video from the camera 36 of the 
second video subsystem 3, received via the broadband link 12. 

At this point, it will be assumed that a third subscriber has accessed the system from 
near the second video subsystem 3 usii^ his mobile sution 37 and has reached a 
20 "Conference Domain" display format on the second video subsystem 3. 

The "Conference Domain" display includes a conference access code, which changes 
from time to time. In order to take part in a conference a subscriber must enter this 
code using his mobile station. When a subscriber has entered the conference access 

25 code, the relevant control process instructs the audio subsystem 4 to add the 

subscriber's channel to a conference group. Subscribers whose channels have been 
added to the same conference group can talk to other subscriber's, whose channels are 
members of the same group, while seeing them on their local display screen 22, 32. If 
a large number of subscribers are using "Conference Domains", they may be 

30 distributed amongst a plurality of conference groups to limit the number of 
subscribers using any one conference group. 
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The purpose of the conference access codens to ensure that callers usix^ conferencing 
are actually near one of the video subs3^ms 2» 3. 

5 When the first subscriber indicates his wish to move on, the first control process sets 
up the next display format, called •Tweeny4''. **Tweeny4'' is identical to page 
''Tweenyl" save for the video and audio files played. 

Finally, when the first subscriber indicates his wish to move on from *'Tweeny4'*, the 
10 first control process sets up the display format "Tweenyl" again. 

If at anytime all the subscribers using one video subsystem 2, 3 terminate their calls, 
the relevant control process sets up that video subsystem's initial display format. 

15 In the foregoing, the present invention has been described with reference to an 
embodiment in which a plurality of subscribers can interaa with one video 
subsystem simultaneously and in which there is a predefined sequence of display 
formats. It will be appreciated that the display formats may comprise a web with 
formats having links to one or more other formats. Such an arrangement of formats 

20 is particularly suited a system having only one input audio channel per video 
subsystem. However, navigation through a web in a multiuser system may be 
achieved by acceding to the wishes of the majority with a random function to settle 
voting ties. With a web structure, the management subsystem would not set the 
order in which formats are used. 

25 

The video subsystems have been described as having a single display screen using one 
format at any given time. However, each video subsystem may comprise a plurality 
of screens, each using a different format for a different user. A plurality of screens 
may be used to display parts of a single ims^e according to a sii^e format. 
30 Furthermore, one display may be segmented to display images according to more 




than one format at a time, for instance so that different users can have absolute 
control over the selection of fomuts of interest. 

The distribution of video files is described as usii^ the ISDN links 23, 33. It will be 
appreciated that these files may be distributed using data carriers, e.g. disks or upes. 

If a plurality of video subsystems require the same image data, this data may be 
distributed using a broadcast technique, for instance tising a satellite, or digital or 
analogue terrestrial television channels. 

The ISDN links 23, 33 may be replaced by telephone links, either fixed or mobile. A 
portable video subsystem is envisaged which includes mobile telephone apparatus for 
communicating with the control subsystem. 

The microcomputers used to embody the various subsystems have been described in 
outline only. The skilled reader, however, will appreciate that these microcomputers 
may include additional standard elements, including disk drives, monitors, 
keyboards, etc. 




Claims 

1 . An interaaive display system comprising: 

an audio subsystem configured for receiving audio conununication signals via 
a wide area communications network and generating control signals in dependence 
on the received audio communication signals; 

a control subsystem configured to respond to said control signals from the 
audio subsystem by issuing display conunands, and 

a video subsystem including display means, configured to be responsive to said 
display commands to display on the display means images defined by image data, 

wherein the video subsystem is remote from the control subsystem and said 
image data is provided to the video subsystem independently of the display 
commands. 

2. A system according to claim 1, wherein the video subsystem includes local 
dau storage means storing said ims^e data for display in response to the display 
conunand. 

3. A system according to claim 1 or 2, wherein the video subsystem includes 
input means for receiving real-time video signals. 

4. A system according to claim 1, 2 or 3, wherein the transmission of the display 
commands requires a bandwidth insufficient for the transmission of real-time video. 

5. A system according to claim 4, wherein the transmission of the display 
commands requires a bandwidth insufficient for the transmission of real-time video 
having a frame rate greater than twenty frames per second. 

6. A system according to any preceding claim, wherein the control subsystem is 
linked to the video subsystem by a communications channel having supporting a 
maximum bit rate of 64kbits s'\ the display commands being sent via said channel. 




7. A sy5tem according to any preceding claim, wherein the control subsystem is 
configured to respond to said control signals from the audio subsystem by issuing 
audio subsystem control commands. 

8. A system according to claim 6> wherein the control subsystem is configured to 
respond to a control signal to issue both a display command for causing a moving 
image to be displayed by the video subsystem and an audio subsystem control 
command to cause the audio subsystem to make available via the wide area 
conununications network audio signals for accompanying the moving image. 

9. A system according to any preceding claim, wherein the wide area 
communications network comprises a public telephone network. 

10. A system according to any preceding claim, wherein the wide area 
conununications network comprises a mobile telephone network. 

11. A system accordii^ to any preceding claims wherein said audio 
conununication signals and/or said audio signals are conveyed in a telephony 
channel. 

12. A system according to any preceding claim, including a plurality of video 
subsystems. 

13. An interaaive display method comprising the steps of: 
providing a supply of inuges data at a remote display station; 

receiving at a central station an audio communication signal via a wide area 
communications network and generating control signal in dependence on the 
received audio communication signal; 

issuing from the central station a display conunand to the remote station in 
dependence on the received audio conununication signal; and 




displaying an image at the display station in dependence on the display 
command, said image including a portion defined by image data from said supply. 

14. A method according to claim 13, wherein the provision of a supply of ims^es 
comprises storing image data in a dau stor^e device at the remote display station. 

15. A method according to claim 13 or 14» wherein the provision of a supply of 
ims^es comprises providing a receiving means receiving real-time video signals. 

16. A method according to claim 13, 14 or 15, wherein the transmission of the 
display conunand requires a bandwidth insufficient for the transmbsion of real-time 
video. 

17. A method according to claim 16, wherein the transmission of the display 
command requires a bandwidth insufficient for the transmission of real-time video 
having a frame rate greater than twenty frames per second. 

18. A method according to any one of claims 13 to 17, wherein the display 
conunand is sent to the video subsystem by a conununications channel havii^ a 
maximiun bit rate of 64kbits s'^ 

19. A method according to any preceding claim, including the step of responding 
to said control signal by issuing audio subsystem control conunands. 

20. A method according to claim 19, comprising the step of issuing substantially 
simultaneously both a display command for causing a movii^ inu^e to be displayed 
by the video subsystem and an audio subsystem control command to cause the audio 
subsystem to make available via the wide area conununications network an audio 
signal for accompanying the moving image. 
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21. A method according to any preceding claim, wherein the wide area 
communications network comprises a public telephone network. 

22. A method according to any preceding claim, wherein the wide area 
communications network comprises a mobile telephone network. 

23. A method according to any preceding claims wherein said audio 
communication signal and/ or said audio signal are conveyed in a telephony channel. 

24. A apparatus comprising a display and processing means configured for 
controlling the display according to a stored program and user input commands input 
via a telephone network, wherein the user input commands comprise telephone 
dialling signals. 

25. An apparatus according to claim 24, wherein the processing means is 
configured for controllii^ the display according to user input commands input from 
different sources via the telephone network. 

26. A system according to any one of claims 1 to 12 and claim 24 or 25. 

27 . A videophone system for use with mobile telephones comprising: 

a first video subsystem including a display and a video camera and located in 
an area covered by a mobile telephone network; 

a second video subsystem including a display and a video camera and located 
in an area covered by a mobile telephone network; 

commimication means for conveying signals from the video cameras between 
the video subsystems; and 

an audio subsystem configured for receiving first and second concurrent 
telephone call from mobile telephones and providing an audio connection between 
said calls to enable the calling parties to converse. 




28. An af>paratus according to any one of claims 1 to 12 or 26 and daim 27. 

29. A tel^hony interface con^rinng connectii^ means for conneaion to a 
plurality of tdephony circuits, signal processing means for produdi^ audio signak 
from audio signal datt and switching means configured to seleaively applying audio 
signals produced by the signal processii^ means simultaneously to a plurality of 
telephony circuits by means of the conneaion means. 

30. A telephony interface according to claim 29, wherein the switching means is 
configured to selectively connea telephony circuits to each other by means of the 
connection means. 

31. A telephony interface according to claim 29 or 30, wherein the switching 
means includes processing means operating under the control of a program or 
programs, the program or programs defining a set of switching states of the switching 
means. 

32. An apparatus according to daim 7 or 27, indudmg an interface accordii^ to 
any one of daims 29 to 31. 

33. A video subsystem of a telephonecontrolled interactive display system 
induding display means, configured to be responsive to display commands fi-om a 
remote control subsystem to display on the display means images defined by image 
dau, said Iwagfi data being provided to the video subsystem independently of the 
display commands, and means for making available to a person viewing the display 
means a telephone number that can be called to establish an interactive relationship 
between said person and the display system. 



34. An interaaive display system substantially as hereinbefore described with 
reference to Figures 1 to 5 of the accompanying drawings. 
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